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Surveillance Device 

The present invention relates to a surveillance device, a surveillance structure, a 
surveillance system and a method of watching over an area. 

5 

Surveillance devices using imaging techniques are well known in the art. One 
prior art security device contains a camera for collecting image data, and a 
control device responsive to the collected data to cause the camera to track a 
moving subject. Typically the control device operates to cause the image 
10 collection device to pan and/or tilt so as to follow a subject falling within the 
field of view of the pick-up device. The control device includes a servo motor 
and a processing circuit that detects movement within an image and which 
provides control signals to the motor to turn the image pick-up device to follow 
the movement 

15 

The known device uses circuitry which requires calibration and which is 
responsive to ageing and environmental effects. It is thus necessary to 
recalibrate the circuitry on a regular basis if the correct information is to be 
picked up. Another problem with the known device is that it is vulnerable to 
20 distraction. Since the device is primarily response to data within the current 
field of view, one subject can enter the field of view and retain the attention of 
the device by suitable movements while the activities of a second subject out of 
the field of view remain undetected. 

25 It would be advantageous to provide a device embodiments of which would be 
capable of avoiding the above-mentioned difficulties. 
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According to a first aspect of the present invention there is provided a 
surveillance device comprising a support constructed and arranged to be 
secured to a structure, a first image collection device secured to the support, a 
second image collection device and a servo motor, the second image collection 
5 device being moveable with respect to the support by the servo motor, the 
second image collection device having an optical axis whereby the servo motor 
is constructed and arranged to regulate the direction of the optical axis of the 
second image collection device. 

10 The first image collection device may comprise plural camera devices. 

In an embodiment, the first image collection device is fixed to the support in 
use and is constructed and arranged permanently to monitor a scene. Data 
collected from the first image collection device are processed and used to 
15 control the servo motor when an event is detected. In embodiments where a 
high speed servo motor is provided, the second image collection device can 
respond to more than one event of interest detected by the first image collection 
device, the response being to cycle between the detected events. 

20 The device may comprise a processor having a first port connected to receive 
data representatives of images collected by the first and second image collection 
devices, the second port connected to the servo motor for control thereof and a 
third port connected to a data input/output interface device. 

25 Where the device operates using only digital signals, the need for recalibration 
can be entirely or substantially avoided. 
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In one embodiment, the first and second image collection devices each include 
respective embedded processing circuitry, each embedded processing circuitry 
being connected to communicate with the first port of the processor device. 

5 In one embodiment the processor device is operable to monitor data received 
from the embedded processing device of the first image collection device and, 
in respect thereto, to supply commands to the servo motor via the second port. 

In another embodiment, the processor device converts data from the first and 
10 second image collection devices using a communications protocol into a pulse 
stream for output at the third port. 

The second image collection device may have a zoom input and a field of view 
be variable in dependence on a control signal at the zoom input 

15 

The second image collection device may have a tilt input, and a field of view be 
variable in dependence on a control signal at the tilt input 

According to a second aspect of the present invention there is provided a 
20 surveillance system comprising the surveillance device in accordance with the 
first aspect and a computer remote from the surveillance device, the system 
further comprising a communications device interconnecting the surveillance 
device and the remote computer. 

25 In one embodiment the communications device comprises an Ethernet cable. In 
another embodiment the communications device comprises a wireless 
communication system. 
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In one embodiment the wireless communication system comprises a radio 
channel. 

5 In one embodiment, the wireless communication system comprises a wireless 
LAN or"WiFi". 

According to a third aspect of the invention mere is provided a method of 
automatically watching over an area without operator supervision using a 

10 surveillance device having a first spatially fixed image collection device and a 
second image collection device having a movable field of view, the device 
having an output for image data, the method comprising using the first image 
collection device to observe the area to detect movement; upon detection of 
movement, transferring signals from the first image collection device to the 

15 output, said signals representative of an image of at least a location where said 
movement takes place, and controlling the field of view of the second image 
collection device to observe the location where said movement takes place, 
and, transferring signals from said second image collection device, said signals 
being representative of an image of said location where said movement takes 

20 place at least while said movement is detected. 

According to a fourth aspect of the invention there is provided a surveillance 
device having plural spatially fixed camera devices, each spatially fixed camera 
device having a fixed field of view, at least one further camera device, the at 
25 least one further camera device having a field of view movable in space, and 
processing circuitry operable in response to signals from at least one of said 
plural spatially fixed camera devices to cause the field of view of the at least 
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one further camera device to include a given area. 

According to a fifth aspect of the invention there is provided a surveillance 
structure comprising a support having plural socket devices secured thereto 

5 each for receiving a respective camera and at least one further socket device for 
receiving a first camera, the or each further socket device being coupled to the 
support via a motor drive constructed and arranged to move the further socket 
device in rotation about the support, the surveillance device further comprising 
a respective electrical connector device for each socket device and further 

10 socket device, a further electrical connection device for receiving a device for 
communicating with said socket devices and further socket devices, and 
communication network circuitry interconnecting said electrical connector 
devices. 

15 Further circuitry may connect the further electrical connection device to the 
motor drive. 

The device for communicating with said socket devices and further socket 
devices may comprise an intelligent hub device. 

20 

An advantage of this structure is that it can be embodied as a "one size suits all" 
structure in which only those sockets needed for the area being scrutinised are 
in fact occupied by fixed reference cameras. The structure can be such that 
cameras can simply be manually plugged in to the electrical connections and the 
25 structure then supports the cameras. The electrical communication network 
may be self configuring with a "plug and play" type of set-up to cope with 
different numbers and locations of cameras. 



WO 2004/042667 PCT/GB2003/004691 



In embodiments, the controlling feature is provided predietively, whereby 
previous locations of motion of an object of interest are used to determine 
where to aim the movable camera. 

5 

In embodiments, there is provided an "auto-ignore" feature to account for 
movement of features such as trees and plants, so that the moving camera is not 
sent to examine areas of no interest. The auto ignore may allow the movable 
camera to move to view an area for example only where the speed of movement 
10 is above a set or variable threshold, or where the object is above a given number 
of pixels in size for a particular zoom, or where speed is below a threshold, or 
where the size is below a set threshold. Locking onto a target may only occur 
when one or more of these conditions pertains. 

15 After information is picked up by the camera the information may be presented 
to a viewer, e.g via a transmission network such as a wireless LAN, or may be 
archived onto a storage medium 

Exemplary embodiments of the invention wilt now be described with reference 
20 to the accompanying drawings in which: 

Figure 1 shows a schematic perspective view of a surveillance device 

embodying the invention; 

Figure 2 shows a view similar to that of Figure 1 with cameras removed; 
Figure 3 shows a block schematic representation of a surveillance system 
25 embodying the present invention, and 



Figure 4 shows another exemplary physical layout of a surveillance 
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device embodying the invention. 

Referring to Figure 1 a surveillance device 1 has a support 2 which is 
constructed and arranged to be secured to a structure, for example to a support 
5 pole or to a bracket secured to a building. The support of this embodiment 
includes three spaced generally circular plates 2a, 2b, 2c. A first image 
collection device 3 here consists of a discrete digital camera devices 4-1 1 (8-1 1 
not visible in the drawing) disposed circumferentially about the support 2 with 
each digital camera device providing a 48 degree field of view. The first image 

10 collection device is disposed between the first and second plates 2a, 2b. The 
presently described embodiment provides 360 degree vision, the field of vision 
of the cameras providing a small degree of mutual overlap. In other 
embodiments, fewer cameras will be provided. For example if the surveillance 
device is secured to a building, it may be necessary to provide only 180 degrees 

15 of vision, in which case only four cameras need be provided, or 90 degrees in 
which case only two cameras are needed. 

The surveillance device 1 further includes a second image collection device 20 
here disposed under the first image collection device 3, and between the second 

20 and third plates 2b, 2c. The second image collection device 20 is likewise a 
digital camera having a 48 degree field of view, the camera 20 being capable of 
pan, tilt and zoom action. The tilt and zoom functions may be provided 
digitally for example by known image processing techniques, or may be by 
physical movements of components within the camera or of the camera 30 

25 itself. The pan function is provided by a servo motor (75, see Figure 2) which 
drives the camera 20 around the support as shown by arrows A and B in Figure 
1. As the present embodiment relates to a surveillance device capable of 360 
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degree surveillance, the camera 20 is capable of 360 degree rotation about the 
support 2. Where less than 360 degree vision is required, the camera 20 may be 
limited in movement, either physically or by virtue of a control program. 

5 Although the present embodiment only shows a single camera 20, it would be 
possible to provide further cameras similar to the camera 20 and each capable 
of mutually independent pan, tilt and zoom where a high traffic is expected. 
The servo motor 75 is selected together with the weight of the camera 20 to 
allow rapid panning of the camera so as to allow the camera to switch between 

1 0 different detected events. 

i 

A support 2 embodying the invention is shown in Figure 2, with the cameras 
removed. The first, second and third circular plates 2a, 2b, 2c are spaced apart 
along a central column 100 along the axes of the plates. A cylindrical wall 101 

15 is disposed between the first and second plates 2a, 2b. The wall 101 defines 
eight identical sockets 102-109 (four only visible) disposed regularly around its 
periphery. The sockets 102-109 afford housings for cameras 4-11, which can 
be mounted to the support by insertion into the sockets. The support contains 
electrical circuitry with connectors in each socket to allow communication and 

20 control, as will later be described with respect to Figure 3. In the present 
embodiment, the support as delivered includes removable blanking plates 
covering each socket. The blanking plates are removed and cameras in the 
number needed for the application are inserted into the selected sockets. 

25 Continuing to refer to Figure 2, a second cylindrical wall 100, extends 
downwardly from the second plate 2b and a third cylindrical wall 111 extends 
from the third plate 2c, the cylindrical walls 1 10, 1 1 1 leaving between them a 
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slot 1 12 of constant width. A camera mount 120 extends through the slot 1 12, 
and is driven in rotation about the column 100 by means of the servo motor 75 
(not visible). The camera mount 120 includes an electrical connector for a 
camera and, similarly to the sockets 102-109 acts to support a manually-inserted 
5 camera. As noted above, the device 2 can be extended by addition of further 
movable cameras by adding a further circular plate with slot-providing 
cylindrical walls. 

In the described embodiment, a dome covers the support and provides weather- 
10 proofing in use. Where no dome is provided, the removable covers may 
provide weather-proofing and the slot 1 12 may have a gasket arrangement 

In Figure 3 an embodiment having only a first image collection device with 
only two digital cameras 4, 5 and a single camera 20 forming the second image 

15 collection device is shown. Each of the cameras 4, 5 consists of a respective 
lens 40, 50, a respective image pick-up device 41, 51, for example a CCD pick- 
up, and respective embedded processing circuitry 42, 52. The embedded 
processing circuitry 42, 52 includes on-chip memory storing instructions 
necessary for operation of the processing circuitry. Each of the digital cameras 

20 4, 5 has additionally embedded processing circuitry 42, 52 connected via a LAN 
connection 80 which enables me image collection devices to output collected 
data. The LAN 80 extends to an intelligent hub device 70 which receives 
information from each of the image pick-up devices 4, 5. 

25 In the present embodiment, each device on the LAN has its own time slot and 
communication is thus cyclic. Other techniques can be substituted for this - for 
example, there may be a priority allotted to some devices, or a token ring 
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communication protocol can be used. The way the LAN communicates may be 
chosen according to the system architecture - for example in embodiments 
where me intelligence is well-distributed regular communication may be less 
essential than in embodiments where centralised control is provided. 

5 

The camera 20, similarly to the cameras 4, 5 also includes a lens 60, an image 
pick-up 61 and embedded processing circuitry 62. The camera 20 is controlled 
in rotation about the support 2 by the servo motor 75, which is connected to, 
and controlled from, an output port 71 of the hub device 70 via a bus connection 

10 72. The camera 20 also receives signals from a control bus 73, 74, here shown 
as two separate buses for clarity so as to effect the zoom and tilt of the camera 
20. In this embodiment, the bus 73 controls a digital zoom feature of the 
camera and the bus 74 controls a digital tilt feature. However, it would 
alternatively be possible to provide a moving zoom leans and a second servo 

1 5 motor to physically tilt the camera 20 if preferred. The buses 73 and 74 connect 
to a further port 76 of the hub 70. 

The hub further has a data input/output interface port 76, which connects here 
via an Ethernet link 90 to a remote computer 200. The remote computer 200 
20 includes a processor 201 running a program shown symbolically as block 202 
and is connected to a store device such as hard disk 203 to store information on 
the hard disk, the information being derived from that provided over the 
Ethernet link 90. 

25 In other embodiments, the Ethernet link 90 is replaced or supplemented by a 
wireless data link, or by another wired bus system, for example a USB. In these 
cases an interface device will be required between the surveillance device 1 and 
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the communication channel and the communication channel and the computer 
200. 

In operation, the cameras 4, 5 monitor a 90 degree angle. The hub 70 operates 
5 the LAN 80 on a clocked basis and cyclically connects between the pick-up 
devices 4, 5. The embedded processing circuitry 42, 52 in the described 
embodiment includes firmware as previously discussed, for image analysis so 
that data output to the LAN 80 consist only of significant information. That is 
to say, the imaging output over the LAN 80 is compressed image data rather 
10 than raw data, for example such that the data represents only motion data. The 
processing circuitry 42, 52 converts the data into the correct form for the LAN, 
eg to IP data. The firmware may also carry out supervisory and control 
functions, for example adjusting operation for varying light conditions. 

15 In other embodiments the processing circuitry 42, 52 does not run such 
firmware and merely acts to convert the data received from the CCD devices 
41,51 into the correct protocol for the LAN 80. 

Again in the present embodiment, the intelligent hub 70 acts a server to the 
20 LAN with the cameras 4, 5, 20 acting as clients. The hub is programmed to 
respond to data on the LAN 80 indicative of movement in the area under 
observation and in response thereto controls the servo motor 105 and the tilt and 
zoom buses 73, 74 to cause the camera 20 to home in on the movement. In this 
embodiment the hub 70 is programmed to assess the size of the moving subject 
25 by assessing the size of the moving subject in terms of pixels and the amount of 
zoom currently applied. The device may be programmed to ignore subjects of 
less than a threshold size, so as to disregard moving leaves, birds and the like. 
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However, in other embodiments, all moving subjects may be tracked by the 
camera 20. 

The hub 70, in any event, converts the incoming data from the LAN 80 to the 
5 relevant format for the communication link 90, so that all movement data is 
provided to the compute 200. In the computer 200, the data are provided to the 
processor 201 and processed by the software 202. The data are then stored on 
the hard drive 203. The hard drive is written to in a recirculating form so that 
once the hard drive reaches a given state of fullness, rewriting starts at the 
10 earliest entry. 

Although the present embodiment has been described as having substantial 
intelligence built into the surveillance device 1, specifically the computer 200 
could represent the intelligence in the system, and the processing devices in the 
1 5 image pick-up devices, the camera and the hub could merely reformat data. 

It is fundamental to the preferred embodiments that no human control or 
supervision is needed to direct the operation of the device, at least once set up. 
The software of the system is, in these preferred embodiments, capable of 
20 assessing the activity in a scene being monitored and to direct the relevant 
image pick-up device(s) to zoom, pan and tilt appropriately to input visual data 
likely to be of interest Such data may be archived, presented for viewing or, if 
so desired, cause an alarm to be sounded. 

25 It would alternatively be possible to provide all of the intelligence in the camera 
itself and confine the functionality of the computer 200 to recording data. 
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Power may be provided for the device 1 from a mains power supply, by power 
over Ethernet; by the use of photovoltaic cells, wind turbines or otherwise as 
known. 

5 The presence of the two fixed cameras 4, 5 in the embodiment (more cameras in 
embodiments where a wider range of observation is needed) means that the area 
being observed is constantly under observation. The device is programmed to 
cause the moving camera 20 to shuttle between multiple moving subjects if 
these are in different zones of the area* and to forward image data of the 

10 activities of each subject for recording. Where a relatively busy area is being 
observed, plural moving cameras are provided, and each camera may be allotted 
particular subjects using an algorithm to increase observation efficiency. Hence 
if two cameras are provided and five subjects are moving, the device may 
divide the subjects by location to minimise camera movement, or zoom/tilt 

15 changes.. 

Although the described embodiment uses cameras with all associated circuitry 
on-board, camera costs may be reduced by providing the embedded processing 
circuitry 42, 52 as part of the support device itself, along with the LAN and hub. 
20 In other embodiments, the circuitry of the support includes only the LAN 
wiring, the intelligent hub, and sockets for cameras having their own on-board 
processing. 

In an embodiment, the cameras are analogue PAL cameras. In another 
25 embodiment digital cameras are used. Where megapixel digital technology is 
employed electronic pan, tilt and zoom can be used within each reference 
camera as well as the mechanical pan, tilt and zoom (where available) to cover 
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more simultaneous occurrences or events. This allows the mechanical pan, tilt 
and zoom to have a greater life expectancy. 

5 The zoom level of the pan, tilt and zoom camera may be used in calculating the 
size of the moving object from the reference camera with a pre-determined 
desired zoom setting, this zoom level being termed "zoom factor** In some 
embodiments, me images captured from the moving camera are not used in 
controlling the pan, tilt or zoom mechanism, this control being exclusively from 

10 the reference cameras. In other embodiments, image data from the moving 
camera is used to determine pan, tilt and zoom instructions, for example for 
object tracking purposes 

When in an external environment the quality of a picture varies immensely due 
1 5 to noise. This may result in the image processing system momentarily losing its 
subject (say losing one or two frames). Coupled with this noise problem, 
shadows of a moving object also add to the processing burden where an object 
is moving. Thus the time that the system momentarily loses its subject may be 
the same time that the subject gains a shadow - mis shadow could then 
20 momentarily become the only moving object in the scene and hence the only 
information available to predict where the object is moving towards. 

The problems may be solved by using an algorithm, e.g. a least squares fit 
algorithm, to balance the centre of mass taking all the above into consideration 
25 so the camera smoothly follows the heaviest dense mass without darting off on 
each frame's prediction point The algorithm may use a number of historical 
frames as well as a least squares fit algorithm to smooth the operation. 
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Figure 4 shows another embodiment of the surveillance device, having a 
support (100), a set of reference cameras (105) and a dome covering a moving 
camera (110). 

Am embodiment of the present invention has been described with particular 
reference to the example illustrated. However, it will be appreciated that 
variations and modification may be made to the example described within the 
scope of the present invention. 



